On the asymptotic normality of hierarchical mixtures-of-experts for generalized linear models
نویسندگان
چکیده
| In the class of hierarchical mixtures-of-experts (HME) models, \experts" in the exponential family with generalized linear mean functions of the form (+ x T) are mixed, according to a set of local weights called the \gating functions" depending on the predictor x. Here () is the inverse link function. We provide regularity conditions on the experts and on the gating functions under which the maximum likelihood method in the large sample limit produces a consistent and asymptotically normal estimator of the mean response. The regularity conditions are validated for Poisson, gamma, normal and binomial experts.
منابع مشابه
Bayesian Inference for Spatial Beta Generalized Linear Mixed Models
In some applications, the response variable assumes values in the unit interval. The standard linear regression model is not appropriate for modelling this type of data because the normality assumption is not met. Alternatively, the beta regression model has been introduced to analyze such observations. A beta distribution represents a flexible density family on (0, 1) interval that covers symm...
متن کاملOn the Approximation Rate of HierarchicalMixtures - of - Experts for Generalized
We investigate a class of hierarchical mixtures-of-experts (HME) models where generalized linear models with nonlinear mean functions of the form (+ x T) are mixed. Here () is the inverse link function. It is shown that mixtures of such mean functions can approximate a class of smooth functions of the form (h(x)) where h() 2 W 1 2;K (a Sobolev class over 0; 1] s), as the number of experts m in ...
متن کاملBayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Application to Speech Recognition
Machine classi cation of acoustic waveforms as speech events is often di cult due to context-dependencies. A vowel recognition task with multiple speakers is studied in this paper via the use of a class of modular and hierarchical systems referred to as mixtures-of-experts and hierarchical mixtures-of-experts models. The statistical model underlying the systems is a mixture model in which both ...
متن کاملLogistic Mixtures of Generalized Linear
Title of Dissertation LOGISTIC MIXTURES OF GENERALIZED LINEAR MODEL TIMES SERIES Neal Overton Je ries Doctor of Philosophy Dissertation directed by Professor Benjamin Kedem Mathematics Department Statistics Program In this dissertation we propose a class of time series models for mixture data We call these logistic mixtures In such models the mixture s component densi ties have a generalized li...
متن کاملAsymptotic Normality in Generalized Linear Mixed Models
Title of dissertation: ASYMPTOTIC NORMALITY IN GENERALIZED LINEAR MIXED MODELS Min Min Doctor of Philosophy, 2007 Dissertation directed by: Professor Paul J. Smith Statistics Program Department of Mathematics Generalized Linear Mixed Models (GLMMs) extend the framework of Generalized Linear Models (GLMs) by including random effects into the linear predictor. This will achieve two main goals of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IEEE Trans. Information Theory
دوره 46 شماره
صفحات -
تاریخ انتشار 2000